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CURRENT PRACTICES AND INNOVATIONS IN 
THE TEACHING OF EDUCATIONAL PSYCHOLOGY 


1) The Teaching of Educational Psychology: Current Prac- 
tices and Effective Innovations in Introductory Courses. 

2) An Approach to Teaching Educational Psychology. 

3) Teaching Procedures in Educational Psychology. 

4) The Teaching of Educational Psychology. 


INTRODUCTION 


In 1947, the Executive Committee of the National Society of 
College Teachers of Education organized several committees 
to study the various aspects of teacher education. One of these 
committees was assigned the task of recommending the content, 
sequence, organization, and teaching procedure for courses in 
educational psychology.' This committee has made four reports 
of progress. The first report, made in 1948, outlined the facts 
and principles from several areas of psychology as they relate to 
curriculum development.? The second report, made in 1949, 
dealt with the nature of educational psychology and the con- 
tributions it has made and can make to the preparation of 
teachers.* The third report outlined the basic content in several 





1The chairman of this committee is Walter W. Cook, University of 
Minnesota; the vice-chairman is Wm. Clark Trow, University of Michigan; 
the sponsor for the Executive Committee of the N.S.C.T.E. is Dean A. 
Worcester, University of Nebraska; Members of the Committee are: 
G. Lester Anderson, College of the City of New York; Warren R. Baller, 
University of Nebraska; Glenn M. Blair, University of Illinois; William F. 
Bruce, State University Teachers College; Oneonta, N.Y.; F. S. Freeman, 
Cornell University; Harry N. Rivlin, Queens College, and Donald Snygg, 
State University Teachers College, Oswego, N.Y. 

*“‘The Psychological Basis of the Modern Curriculum,” The Journal of 
Educational Psychology, March, 1948. Vol. 39, pp. 129-169. 

3 “Educational Psychology in the Education of Teachers,”’ The Journal 
of Educational Psychology, May, 1949. Vol. 40, pp. 257-294. 
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areas of educational psychology for teacher education.‘ The 
fourth report consists of the four papers presented here. They 
deal with current practices and innovations in the teaching of 
educational psychology. The final report of the Committee 
on Educational Psychology will be made in 1952. 





‘ “Educational Psychology for Teachers,” The Journal of Educational 
Psychology, October, 1950. Vol. 41, pp. 321-272. 

’ The four papers presented here—‘‘The Teaching of Educational Psy- 
chology: Current Practices and Effective Innovations in Introductory 
Courses,’’ by Warren R. Baller, University of Nebraska; ‘‘An Approach to 
Teaching Educational Psychology,” by John E. Horrocks, Ohio State 
University; ‘‘Teaching Procedures in Educational Psychology,” by Lois B. 
Murphy, Sarah Lawrence College and the City College of New York; and 
‘The Teaching of Educational Psychology,” by Harry N. Rivlin, Queens 
College—were read at the Atlantic City Meeting of the National Society of 
College Teachers of Education, February 19, 1951. 








1) THE TEACHING OF EDUCATIONAL 
PSYCHOLOGY: CURRENT PRACTICES AND 
EFFECTIVE INNOVATIONS IN 
INTRODUCTORY COURSES 


WARREN R. BALLER 
The University of Nebraska 


The introductory course in Educational Psychology at the 
University of Nebraska bears the title, ‘‘The Study of Human 
Behavior and Development.’”’ The course extends through two 
semesters and carries six hours of credit. It is required of all 
students in the Teachers College and enrols approximately five 
hundred students per semester plus an additional hundred in the 
summer term. 


A TWO-SEMESTER COURSE 


The somewhat uncommon two-semester arrangement was 
adopted with four main purposes in mind, One was to provide, 
by the lengthening of the course, for the inclusion of certain 
concepts which customarily would be secured from beginning 
courses in general psychology. No pre-requisite of general 
psychology is required for the present course; nor was it required 
for the course which the present one supplanted. 

Another purpose behind the lengthened arrangement was to 
have it absorb in addition to its three-credit predecessor two 
other courses one or the other of which was taken by a majority 
of the students. These were offerings in child psychology and 
adolescent psychology. They were assimilated into the present 
course in the hope that one result would be a setting in which 
more emphasis could be given to the long view, and continuity, 
of development than was possible with the older plan. It was 
felt also that the newer plan would have the advantage of 
eliminating some unprofitable overlap which existed among the 
original courses. 

The attention which is given in the present plan to methods 
of evaluating the child’s growth and development has led to the 
discontinuance of still another course. This was one in educa- 
tional measurements which was required of students in elementary 


education. Considerable opportunity for the student to apply 
3 
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and interpret psychological and educational tests is afforded 
by the present arrangement, particularly in connection with case 
studies which will be described later. 

A third main reason for adopting the six-hour, two-semester 
sequence was to extend the period of interaction between the 
more formal aspects of the course and a variety of experiences 
which the students are engaged in with children. A majority 
of the students are involved in the making of studies of individual 
children and the assumption is that the paralleling of such 
studies with the rest of the course for a nine-month period has 
advantages over such an interrelationship limited to one semester. 
Some of the children who are studied individually as part of this 
course are also being studied by the same students as part of 
the work of other courses. 

The fourth argument for the two-semester plan was to make 
possible more of interrelationship between the introductory 
educational psychology and other subjects in teacher education 
which the student would be taking during the year. The 
reference just made to the study of a child in connection with 
differing tasks of two separate courses is one illustration of this 
point. Clearly the opportunities for this kind of thing were 
increased when the course was doubled in length. 

The experience to date with the two-semester arrangement 
has been encouraging. The arguments which were given 
originally for adopting this scheme appear to be, in the main, 
sustained. Dissatisfactions with the plan seem largely to point 
to shortcomings in teaching procedures and teaching aids rather 
than to disadvantages in the over-all arrangement. 


CONTENT OF THE COURSE 


Syllabi have been prepared for the two semesters of the 
course, respectively. The first semester is devoted largely to 
the development of the idea that behavior is caused, and that 
the causes—complex and interrelated as they are—reside in the 
peculiar connections which the individual has with his origins, 
his development, and his surroundings. The second semester 
follows the same general theme into the study of the learner and 
the learning situation with the emphasis upon the nature and 
improvement of the learning process. 
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An attempt has been made to set up main concepts around 
which to organize the knowledge of the course. Some examples 
of these central concepts are as follows: a) The causes of behavior 
are multiple, complex and interrelated; b) The behavior of the 
child reflects, to an important degree, the influence of the institu- 
tions with which he is identified; c) The goals of the learner 
determine in large measure what he will learn in a given situation. 
Some three dozen such statements have been worked out for 
the two semesters with each lesson of the syllabus headed by 
one of them. The idea is similar to that which Lester Anderson 
suggested a year ago in the meeting of this Society.* 


DESCRIPTION OF A TEACHING DEVICE 


A major concern of the instructional staff in the beginning 
course is to learn how the student thinks when he is confronted 
by actual children and to help the student to know the quality 
of his own thinking about behavior. This problem has led to the 
use, in modified form, of a method which has worked successfully 
with teachers in service. It consists of the preparation, reading 
and discussion of a child study record. 

Each student in the class is requested to select some person 
for study. Preferably the person will be a child of the age the 
student expects eventually to teach. The record which is then 
written about the child includes two kinds of description in it. 
One kind, the background material, contains all the information 
about the child which the student considers important and is 
able to secure. The other kind which follows the background 
description is anecdotal in form and dated. 

The student reads his record in class, as a member of a ten- 
person discussion group, or panel, with the remainder of the class 
assuming the rédle of audience. Priority of discussion is accorded 
the members of the panel, although it has been found to be desir- 
able to permit limited discussion from the audience. 

After the student who is the reader has proceeded uninter- 
rupted through the background account or through one or two 
anecdotes, the panel undertakes one or the other of two lines of 





* G. Lester Anderson, ‘‘What the Psychology of Learning Has to Con- 
tribute to the Education of a Teacher,”’ The Journal of Educational Psy- 
chology, October, 1950, Vol. 41, No. 6, pp. 362-365. 
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discussion. One is aimed at securing a more complete descrip- 
tion of the child and his background and more scope to the 
observations of his behavior. The other is aimed at an item- 
by-item analysis of the soundness of the statements which have 
gone into the record. 

The main aim of this procedure is to give the student some 
experience with the evidence of sound thinking versus faculty 
thinking about behavior and development. Specifically he is 
expected to learn the difference between factual description 
of behavior and uncritical explanation. He is taught to be 
careful in the use of value terms. And he is taught the impor- 
tance of extensive information as opposed to limited information 
about a child. 

It is expected that the discussion of the child-study records 
will help give meaning to the main concepts of the course as 
set forth in the syllabus. And in this connection it may be 
emphasized that it is the critical discussion of the record, not 
simply the writing of the record, which makes this objective possi- 
ble. Writing about a child or simply telling about him may serve 
only to stamp in faulty thinking on the part of the student. 

The procedure which has been described is assigned approxi- 
mately one-third of the class periods during the semester. As 
a rule, not more than one record will be presented in a class 
period, while the class is becoming familiar with the process. 
Later in the semester it is possible to increase the number. 

This method is still in the experimental stage and leaves room 
for much improvement. But it does appear to have merit and 
has steadily won favor with students and instructors in the 


course. 
A SPECIAL SECTION OF THE COURSE 


Several kinds of ability sections are possible in a course such 
as this. One which is deemed by the staff to be particularly 
desirable is aimed at securing a second-semester group of students 
who because of outstanding scholarship and other favorable 
traits give promise of eventual qualification for graduate work in 
Education. 

Usually this group consists of twelve to fifteen students who 
meet for one two-hour session per week. Considerably more 
outside reading is accomplished by these students than by the 
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regular classes. Special assignments and projects suited to 
their interests and abilities are undertaken. Opportunities 
are provided for them to meet with, and become acquainted with, 
members of the department staff other than the one who is 
serving as instructor. 

The proportion of the students previously enrolled in this 
section and later identified as particularly outstanding in their 
professional preparation and teaching has been gratifying. 


PREPARATION OF INSTRUCTORS FOR THE COURSE 


Responsibility for the teaching of the introductory course 
in Educational Psychology is shared by members of the senior 
staff and the best qualified of the graduate students enrolled 
in the department. These students are given the rank of part- 
time instructor. During the current school year three senior 
staff members and five part-time instructors are involved in 
teaching the course. 

A scheduled two-hour meeting of the teaching staff is held 
each week. This meeting is devoted to developing and improving 
the plan of the course, the description and selection of teaching 
methods and devices, and the preparation of ways of evaluating 
the outcomes of the course. Basically, the purpose of the staff 
meetings is to make it possible to know the qualifications of the 
instructors and to help them improve in their work with their 
classes. One result of the arrangement is, of course, to provide 
supervised teaching at the college level for doctoral students who 
soon will be seeking full-time college teaching. 

Closely related to the plan just described is a one-semester 
practicum in problems of human behavior and development. 
It is considered that this course will serve as a recruiting place, 
or proving ground, from which to select instructors for the 
introductory course in educational psychology. Methods and 
special procedures employed in the introductory course are given 
special attention in the practicum. An example of.giving the 
student some acquaintance with special procedures in the intro- 
ductory course in educational psychology is to have him help 
with the panel discussions of child-study records. After he has 
observed the method in a regular class and has had some coaching 
in it, he takes over the direction of a panel. Later he, and others 
involved in the practicum, take charge of discussion groups 
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which are separated from the rest of the class. This results not 
only in further experience for the members of the practicum, 
but in the multiplying of the number of discussion groups which 


can be held at a given time. 


CONCLUDING STATEMENT 


Presumably there is much in this introductory course which 
is similar to introductory courses in many other colleges and 
universities. Considerable use is made of film material and some 
use is made of the opaque projector for certain lessons. These, 
however, and the selection of reading materials probably bear 
much resemblance to things being used elsewhere. Suffice it 
simply to state that the features of the course which have been 
discussed are those deemed most likely to be unusual or relatively 


so in the teaching of such courses. 








2) AN APPROACH TO TEACHING EDUCATIONAL 
PSYCHOLOGY 


JOHN E. HORROCKS 
The Ohio State University 


For the past years there has been intermittent speculation, 
sometimes even controversy, as to the function, curriculum 
placement, and appropriate methodology of the elementary 
course in educational psychology. There is probably no per- 
manent answer to this problem, and certainly no answer that 
would be universally applicable wherever the elementary course 
is taught. Each institution has, appropriately, to develop its 
curriculum to serve its own peculiar organization and the 
clientele whom it serves. 


FUNCTIONS AND METHODOLOGICAL ASSUMPTIONS 


The course in elementary educational psychology at the 
Ohio State University is the result of many years of effort and 
experimentation directed toward contributing a more effective 
training program for prospective teachers. At the present time 
the course in educational psychology at Ohio State is organized 
to serve three main functions. First, to teach the facts and 
principles of educational psychology as a codrdinated part of 
the undergraduate teacher-training sequence. Second, to foster, 
in so far as possible in a short time, the social and emotional 
adjustment of the students enrolled in the course. Third, to 
act as a supervised training program for graduate students who 
hope to become college teachers of educational psychology. 

In teaching the course, three assumptions dominate the 
methodology of presentation. First, that knowledge of facts 
and principles does not necessarily result in ability to apply 
those facts and principles. Hence, presentation must not only 
stress application of what is being learned, it must also provide 
students with as much opportunity as possible to actively apply 
what they are learning. Second, examinations, both for students 
and instructors, unfortunately tend to become, if not the course, 
at least the major end for which they learn and teach. Under 
the circumstances, examinations must be applicational as well 


as factual, and must be based specifically on the objectives of 
9 
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the course. Third, that an effective method of carrying out 
the course objectives of applicational and responsible learning, 
and of social and emotional adjustment, is arrived at, in part, 
by means of instructional methods which stress and make use of 
socialized codperative participation on the part of the students 
enrolled in the course. 


A GROUP PROJECT 


Various aspects of the Ohio State course in educational psy- 
chology have been presented from time to time by S. L. Pressey, 
by the writer, and by various others. The present discussion 
will attempt to describe briefly a group project used in the course 
with some success. 

At the beginning of the quarter, as has been described else- 
where,* each section of educational psychology’ is divided into 
six work groups or committees of six members each. A great 
deal of the class learning is carried on by socialized codperative 
methods whereby working groups of students are given a respon- 
sible and active part in their own learning. Early in the quarter, 
after the groups have worked together and accepted the per- 
missive atmosphere of the class as an opportunity to learn more 
effectively, it is proposed that each group become responsible 
for the initiation and completion of a minor research problem 
or a survey which will have applicational implications for educa- 
tional psychology. Each group, after consultation with their 
instructor, select a project topic, plan what is to be done, carry 
out their plan, and finally, at the end of the quarter, present 
their findings to the rest of the class for criticism and discussion. 
An effort is made to have the topics selected be of interest and 
value to teachers. Occasionally, results are such that publica- 
tion is possible in one of the local or state educational journals. 


COMMON GRADE FOR COMMON WORK OF GROUP 


Before work is started on the project it is explained to the class 
that the project is a group responsibility in which everyone is 
equally involved, and that all members of each group of six will 
receive the same grade for their common work. A preliminary 
mimeographed handout presents the project as follows: 





*J. E. Horrocks, ‘‘Methodology and the teaching of educational psy- 
chology’’ Jour. Educat. Psychol., 42, 277-284, 1951. 








The Teaching of Educational Psychology 11 


“Every student in educational psychology is expected to 
participate in a group project this quarter. On 
you will be assigned by your instructor to the group with whom 
you are to work on the project. You will be asked to state 
your preference for the people with whom you would most like 
to work. As nearly as is possible you will be placed with people 
of your choice. 

“The project is to consist of something that involves syste- 
matic observation of human behavior. Scrapbooks, bulletin 
boards, posters, copied charts, and so forth are not acceptable. 
There are, for example, many studies cited in your textbook, 
segments of which you might repeat with profit. It might be 
very interesting to find out which changes, if any, have taken 
place in the years intervening since some of these studies were 
done. Various other experiments or surveys are also possible. 
For example, the effect of and the attitude toward television 
might prove a fruitful field. The six people in your group should 
have little difficulty finding some problem that is really worth 
investigating. Your instructor will make suggestions as to 
where you may find subjects. 

“Before you start gathering data for your project, you should 
have your plans checked and approved by your instructor. 
He has had experience in gathering data and in conducting 
educational and psychological investigations and he will very 
likely be able to point out errors that might cause you to lose 
valuable time and effort. 

“Tt should be understood that with the exception of one day 
for initial planning little class time is to be used for the prepara- 
tion of the project. Most of your planning and work on the 
project is to be done outside class. 

“‘When the project is completed it should be written up in the 
following form: (1) a description of the problem and why it is 
important, (2) procedure—how the project was carried out, 
(3) findings or results—illustrated with graphs, charts, etc., 
(4) recommendations and applications. 

“Each table will prepare one project report which is to be 
typed, double-spaced, and in other ways be in conformity with 
the standards of written work as set forth in the College of 
Education Style Manual. 

‘At the end of the quarter, about three days will be devoted to 
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project reports and class discussion of the projects. How the 
project is to be reported to the class rests with the group doing 
the project. The members of the group may choose one person 
to represent them, or the responsibility may be divided with one 
person being responsible for a section or for several sections of 
the report.” 

An adequate amount of class time is provided for preliminary 
group planning and from time to time during the quarter each 
group of six will spend some time talking over and making addi- 
tional plans for their project. Usually the groups have a number 
of meetings outside of class unless they have planned each 
person’s share in advance. 


MUTUAL EVALUATION OF WORK BY STUDENTS 


One of the more difficult aspects of the project, where the 
instructor is concerned, is the problem of evaluating fairly the 
completed product. Since group processes are encouraged in 
the course it is believed that the students themselves should 
have a share in evaluating their own work both as individuals 
and as a group. First is the problem of what the student has 
done while the project was ‘in committee’—what leadership 
he displayed, how effectively he worked, and to what extent he 
contributed to group thinking. The instructor gains, of course, 
some idea as he listens to the group at work and as he talks to 
individuals, but, in the last analysis those best informed as to 
what has happened and as to what réles were assumed are the 
students who have completed the project together and who have 
suffered from the dilatoriness and ineffectiveness of one of their 
number or who have profited from the enthusiasm and efficiency 
of another. Consequently each student has the task of rating 
on a six-point scale every other student on his committee. This 
is accomplished by each committee member turning in a rating 
sheet for each member of his committee on which he reacts to 
the following: (1) attendance at project meetings, (2) attitude 
toward project, (3) contribution of worthwhile ideas, suggestions, 
etc., (4) how well the student got along with the other members 
of his committee, (5) tolerance and acceptance of majority rule, 
(6) extent to which the member carried on his share of the work. 

When the projects are presented orally and in writing to the 
class at the end of the quarter, class members are required to 
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rate the project, each member of the class turning in a rating 
sheet for each of the six projects. The class rating sheet includes 
the following: (1) Presentation, including organization, origi- 
nality, use of graphic materials, interest; (2) Worthwhileness, 
including applicability to future teaching, relevance to educa- 
tional psychology, value of the experience for the group doing 
the project, scope of the report; (3) Methods and procedures, 
including consistency of the procedures and the findings; (4) 
Evaluation of strong and weak points; and (5) Assignment of a 
letter grade. 

Occasionally a variation on whole class ratings is provided by 
having one committee assume responsibility for rating the 
project of another committee. In this way each project receives 
a joint rating from another committee arrived at after a dis- 
cussion. The instructor, of course, provides a rating of his 


own. 


SECURING SUBJECTS FOR PSYCHOLOGICAL STUDY 


A number of problems have arisen other than evaluation. 
One of the more difficult is the problem of subjects when sur- 
veys or experiments are suggested. For obvious reasons only 
extremely limited use may be made of public school sources and 
only then outside of the county where the University is located 
and where teachers are already burdened with practice-teachers, 
observers, and people wishing to do graduate research. Too 
frequent use of schools for survey or research for minor things 
or for things which do not contribute directly to the schools 
efficiency makes it more difficult when something of major 
psychological or educational significance is proposed. Under 
the circumstances two or three different sources for subjects 
have been found. First, children who are not in school at the 
moment but who are carrying recreational activities on a play- 
ground or elsewhere; second, children in settlement houses or 
formally organized groups as the Scouts; third, members of the 
other elementary educational psychology sections at O. S. U. 
(from eight to sixteen sections are taught each quarter); and 
fourth, school children in the more or less distant home towns 
of some of the class members. We hope in the future to be able 
to establish a relationship with a selected list of schools on the 
basis that the project will be a service one in which the committees 
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will work on problems proposed by the school as something they 
would like to have done or something they would like to know 
about their own school. This last has the advantage of giving 
prospective teachers an additional opportunity to visit schools 
and to become concerned with their actual problems. 


EVALUATION OF THE GROUP PROJECT APPROACH 


It would appear that several advantages are gained by the 
project as described that are consonant with the assumptions 
and point of view which govern the course. First, it provides 
students with an opportunity for productive and codéperative 
work on a project which they feel is of personal interest as well 
as of educational significance. The project thus becomes an 
important aspect of our efforts to promote social competence and 
group procedures. Second, it offers the graduate teaching 
assistants who are instructors an opportunity to work and 
experiment with group learning processes and to become skillful 
in the conduct of classes where such approaches to instruction 
are indicated. Students involved also learn something of the 
technique, since a continuing effort is made to make educational 
psychology a teaching laboratory and the psychological and 
educational significance of everything that is done in class is 
explained. Third, it acquaints students with the purposes and 
methodology of good educational and psychological investiga- 
tions which they, as future teachers, will at least participate in 
at the consumer level. Fourth, it is a method for students to 
critically determine needed areas of investigation based on what 
they know of learning and development, and to integrate their 
findings and apply them. In a sense, the project tends to make 
educational psychology more practical and interesting and 
stimulate the desire to know more about what educational 
psychology has to offer. We have not found that our projects 
are carried on at the expense of the other more traditional aspects 
of educational psychology, but that they are, instead, motivating 
influences for wider and more adequate learning. Fifth, the 
project furnishes an excellent opportunity to discuss problems of 
evaluation and measurement and to allow students to actively 
engage in a considered evaluation of the work of others. Sixth, 
it provides an opportunity to organize, write up and present 
orally and with graphic aids, information to a group of people. 
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In general, we have found that the projects have value both 
for students and for student instructors. It is not our contention 
that the project is the only method (some quarters we replace 
it by other approaches), or that it would necessarily be desirable 
in all colleges or with all instructors. It is simply presented 
as one more of a legion of possible, and partial, approaches to the 
teaching of educational psychology. 








8) TEACHING PROCEDURES IN EDUCATIONAL 
PSYCHOLOGY 


LOIS BARCLAY MURPHY 
Sarah Lawrence College, Bronxville, N.Y., and City College, New York City 


Our aim in the educational psychology course is to help the 
student to become a good teacher and to become clear about what 
he needs to learn to become a still better teacher. A good teacher 
can recognize children’s needs as a group and as individuals, 
can plan and set the stage for spontaneous learning, and also 
give specific help when it is needed; he can help the children 
cope with their difficulties and develop their gifts. In doing 
such things he is spontaneous in giving richly of himself as a 
person, in terms suited to the age and capacities of the group. 
He can use concepts already well established in educational 
psychology; but can also be independent and flexible in dealing 
with problems to which psychology has no neat answer. A 
student can learn something about being a good teacher not 


) only by learning the facts and principles of educational psy- 
_ chology, but by practice in putting them to use; instead, even 


by experiencing them in the educational psychology course 
itself. The educational psychology course should be an illustra- 
tion of the principles of learning and teaching with which it is 
concerned, not a contradiction of them as it would be if it were 
boring, unrelated to the maturity level or interests or back- 
ground of the group, or if it consisted of lectures to passive 


students. 


GETTING ACQUAINTED WITH THE COLLEGE STUDENT 


This point of view has led to a variety of procedures: 

First, getting acquainted with the class, and its equipment for 
thinking about education; what experience, previous training, 
kinds of living have they had which prepared them for or can 
be utilized in this course? 

What experience with children, formal or informal? 

What range of learning experience of their own; have they 
studied music, dancing, art, crafts, sports, typing etc. ? 

What different teaching methods did they experience in these? 

What are the insights into learning which they already use 
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with confidence; what understanding do they have which they 
cannot use, and why? 

What are the problems in helping children about which they 
feel most puzzled or insecure? yr 

How extensive is their knowledge of child development? 
What types of literature in this area are they ready for? What 
books will be old stuff or ‘repeats.’ And what do they need if 
they are to feel stimulated and challenged? 

How narrow and rigid, or broad and flexible, are their concepts 
of education, learning, the task of a teacher, the réle of school 
in a child’s life? Is a teacher supposed to dictate, or guide, or 
be a friend? 

The first week or two, then, consists of discovering the answers 
to such questions as these, in order to find out ‘where we are at’ 
in relation to problems of educational psychology, and to find a 
common basis for work. This involves a) presenting some 
problems in child learning for discussion in order to see how 
different students might deal with them—what insights are used, 
what assumptions are made; in the light of this, discussing areas 
and topics of work and reading; b) discussions of varieties of 
learning experience and the contribution of school, teacher, and 
the child’s own drive to learn, or experience of discovery. 

Autobiographical reports on ‘‘ What I learned as I was growing 
up’’ vary widely from one student to another. One student tells 
how she became aware of the world around her—home, neighbor- 
hood, then the world outside of Kansas City. Another student 
tells how she became aware of adult disguises, fronts, and tech- 
niques of handling children. Still another tells how she learned 
the necessity for adjusting to different settings as she moved 
from one place to another during the War. And other students 
remembered specific learnings such as the struggle to learn to 
ride a bicycle, learning to read by watching the words when her 
mother read stories to her, learning the codrdinations involved in 


playing jacks. 


GUIDING STUDENTS IN THE OBSERVATION OF CHILDREN 


These reminiscences and observations help to illustrate the 
spontaneity of learning, the importance of the experiences to 
which a child is exposed, and the ways in which the shape of life 
itself channels the child’s learning. They begin to stimulate 
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the student to think about the field of learning, the areas within 
it which psychologists have tackled and those which are still 
untouched. ‘These known and unknown areas of educational 
psychology become more clear when we add observations of 
children from infancy to adolescence: 

How do babies learn to suckle, sit, stand, climb out of a high- 
chair, command the attention of the grownups; what differences 
are present when one child learns to talk in single words and 
another uses phrases from the start? 

What learning processes are involved in learning to zip up one’s 
snowsuit, saw a block of wood, make a bridge, paint a picture, 
play with a group of children? 

Why can a seven-year-old grasp the pattern of baseball while 
a five-year gets confused and cries because he wants his side to 
stay at bat? : 

How does a nine-year-old learn to be a member of his gang 
and the fourteen-year-old learn how to take out girls and later 
to love? 

How does a child of any age learn to be chairman of a group 
or to handle a role in a play? 

How do children learn to choose between values that are whole- 
some and those that are harmful? 


APPLYING THE THEORIES OF LEARNING AND DEVELOPMENT 


With such realistic questions as these we look at the more 
formal theories of learning, including those of Thorndike, Watson, 
Kohler, Tolman. We discuss the kinds of learning which occur 
through the formation of associations between repeatedly 
experienced visual, auditory or kinaesthetic stimuli. The réle 
of perception in organizing and selecting from stimuli to which 
the child is exposed, and the larger meanings of observation as 
it goes on in planned and unplanned ways are related to processes 
involved in learning to read and to handle numbers. The rdéle 
of conditioning is discussed especially in relation to emotional 
and social learning, and the effects of success or failure on the 


/playground, on the one hand; the effects of teacher’s attitudes 


in the classroom on the other. Varieties of goals, both con- 
scious and unconscious in the form of needs and interests of 
\which the child may not be completely aware, are discussed in 
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relation to the teacher’s problem of providing satisfaction in 
learning experiences. 

We apply our understanding then to typical learning experi- 
ences through appraising and acting out records of classroom 
copisodes; here we have the rich observations of Mrs. Dena 
Stone, whose material will be available before long in book form. 

From this point our observations are focussed on the individual 
who does the learning; i.e., why learning occurs in one child 
when another child in the same situation learns nothing, or 
something different from what the teacher wishes him to learn, 
or learns to dislike learning in school. 

We consider such questions as these: 

What differences are there between what eight-year-olds and 
what six-year-olds can learn, and why do these differences exist? 
In one group of six-year-olds, what range is there between the 
kinds of learning certain members of the group are ready for, 
and those which other members of the group can take on? 

What are the differences in perception, interests, and motiva- 
tion between the six-year-old who “‘ reads everything in the room”’ 
and the one to whom words look like hen scratches, meaningless 
and dull? 

With two eight-year-olds who cannot spell, why will one be 
helped best by sounding out the letters carefully, and another 
by writing the word many times in different contexts? 

These questions make us aware of differences in grasp of detail, 
capacity for observation, retentiveness, need for different com- 
binations of visual-motor-auditory responses for different children 
with different areas of ease of grasp. 

Observations of children who have trouble in learning press 
further our questions about readiness, adaptation of materials 
to the ability and maturity of the child, motivation of the 
individual learner, areas of interest and initiative of the learner, 
as well as emotional problems of anxiety, in security, or hostility 
and resistance which may block all learning at a given time. 
Each student makes a study of one child who has difficulties in 
learning, and the stages he goes through in response to help. 
One student observes twins who have just been separated for the 
first time and who are withdrawn and lost without each other, 
unresponsive to any activities in the room. Another studies 
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children of recently divorced parents. Another studies children 
who have just moved from a different community who need to 
sink new roots before new growth is possible. Such factors as 
identification with a non-academic parent or refusal to compete 
academically with a more successful sibling, preoccupation with 
artistic, practical or technical interests are discovered by the 
students in these studies, along with difficulties growing out of 
mild defects of vision or hearing which passed unnoticed, or 
difficulties growing out of too wide a gap between the standards 
of the home and those of the school. 


APPRAISING THE EFFECTS OF DIVERSE SCHOOL SITUATIONS 


Appraisal of the methods of teachers in different kinds of 
schools where the students visit for observation serves to sharpen 
their appreciation of what they have been discussing and to 
stimulate more effort to understand. Children go to parochial 
schools, public schools, Progressive and conservative private 
schools. Some children thrive or get along in each kind of school. 
Nearly every school, whatever its label, has some good teachers 
and some poor ones; no system is any better than its teachers. 

Children in both conservative and Progressive schools may 
have high morale and school spirit and may be proud of their 
room, their teacher, and what they are doing. How is this 
morale achieved in each situation? Granting the bad results of 
excessively mechanical ritual and formality, what satisfactions 
exist for children in a flexible use of group ritual? Granted the 
good results of freedom for the child to work on problems of his 
own planning and on his own initiative, what are some of the 
bad results of unguided freedom? When one teacher spends 
the first two months of the year helping the children to accept 
and enjoy each other, how does she accomplish this? And when 
another teacher says, ‘‘Take care of their ego’s and the arith- 
metic will get done three times as fast,”” what does she do, and 
with what results? What is the difference between a teacher 
the children brag about because “‘she’s strict but she’s swell’’ 
and the teacher they hate because she’s an old “‘meany”’ or 
‘*a stinker.” 

In these observations the students see the different kinds of 
strengths different good teachers may have, and also see that 
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no teacher really has all the strengths at once. One teacher 
stimulates the children through his own enthusiasm; another 
releases their ideas and enthusiasms, another seems to remain 
in the background, yet develops an unusual ability to work 
together; how are these things done? 

We compare observations of this kind with what we can learn 
from the study of group dynamics, spontaneity training and the 
psychodrama or even some of the insights in group therapy. 
None of these methods can be applied mechanically to school 
situations, yet all have insights which can be utilized by resource- 
ful understanding teachers, who are aware of the importance of 
release, of achieving emotional integration, creative spontaneity 
and group rapport. 


SELF-RATING BY STUDENTS OF THEIR OWN RELATIONS WITH 
CHILDREN 


Finally we use self-ratings to help the student toward a 
balanced picture of his strengths and weaknesses and his poten- 
tialities. Does he feel secure or insecure about confronting a 
new group, or conducting group discussion? Does he know 
how to start a new skill, or initiate a play? Can he help children 
resolve a conflict or argument or a fight? Can he appraise a 
child’s difficulty in slow grasp of reading or arithmetic skills? 
Can he help children shift comfortably from one activity to 
another? Does he have clear ideas about how to help a child 
grasp a brand-new concept that he has trouble assimilating? 
Can he help children appraise one another’s work constructively 
so that they feel more secure as a result of helpful comments 
rather than insecure or rejected because of criticisms which they 
regard as hostile? Can he discriminate between the necessary 
amount of order to permit good work and order which interferes 
with creativity; and can he also discriminate between freedom 
which releases energy and freedom which goes wild? 

Does he have insight into motivations which contribute to 
maladjustment? Can he build a well-rounded picture of a 
child as a background for understanding the child’s successes 
and his failures in learning? Can he give appreciation con- 
structively and also set limits in such a way as not to arouse 
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resistance? Can he plan ahead a week or a month or a term on 
the basis of his appraisal of the group’s needs and abilities? 

The final work of the year is based on these appraisals and the 
weaknesses which they reveal as seen by the individual student 
himself. In this way the student from beginning to end is 
asking and answering his own questions and actively using his 
learning in the field of educational psychology. 








4) THE TEACHING OF EDUCATIONAL 
PSYCHOLOGY 


HARRY N. RIVLIN 
Queens College 
Flushing, L.I., N.Y. 


That we should be speaking today about the ways in which we 
teach educational psychology is one of the most hopeful signs in 
current college education because it indicates that methods of 
teaching have become a respectable concern of college teachers. 

Though elementary-school teachers and secondary-school 
teachers have long been required to learn how to teach, no such 
preparation has been demanded of college teachers. We have 
apparently been proceeding on the assumption that if the pro- 
fessor is sufficiently well versed in his subject, it is inevitable 
that he will be adept at sharing his wisdom with his students. 
The validity of this assumption has never been demonstrated, 
but it is only within the last few years that our universities have 
begun to think of the need for helping graduate students who are 
entering upon, or returning to, college teaching. 

Those of us who teach education courses are in a vulnerable 
position, for we should be willing to be, as we often are, judged in 
terms of our effectiveness as teachers. A professor in one of the 
other departments on campus can always rationalize his ineffec- 
tive teaching by speaking of his contributions as a scholar in his 
own field. The professor of education, however, has no such 
convenient rationalization, for demonstrating the value of his 
specialization should imply skill in using its findings in his own 
teaching. The professor of educational psychology is more 
vulnerable still, since the psychology of learning is soimportant 
a part of educational psychology that his students, perhaps 
naively, expect him to be an expert not only in teaching psy- 
chology but also in teaching psychologically. 

Teaching educational psychology effectively involves more 
than the adoption of a few new devices, for the effectiveness of 
the new procedure depends so largely upon the skill with which 
itis used. Basically, what we need is not so much the develop- 
ment of new procedures as the ability to make most effective 
use of the procedures we now have. Whether, for example, a 
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new film will be most useful in helping our students to under- 
stand children and adolescents depends in part upon the quality 
of the film; but it also depends, and to a larger degree, upon the 
way in which the instructor helps his students to prepare them- 
selves for seeing the film and the way in which he follows up the 
film presentation. 

As our part of this discussion of the teaching of educational 
psychology, we shall describe how educational psychology is 
taught in the Queens College Teacher Education Program. 
This assignment could be impossibly embarrassing if it were 
misinterpreted as being a description of the perfect, or even the 
best available, method of teaching educational psychology. 
We are so keenly aware of the shortcomings of our procedures 
that we have been revaluating and modifying our program almost 
continuously. Far from being a recital of achievements, this 
paper is just an account of the way in which one college seeks to 
attain the purposes which led it to include educational psychology 
in its teacher education program. 


THE QUALIFICATIONS OF INSTRUCTORS 


We see the teacher as being as important a person in an 
educational psychology class as he is in a high-school algebra 
class or in a nursery school. If educational psychology is to be 
taught effectively, it will be because it is taught by an effective 
teacher who knows his subject and his students and is adept at 
the art of bringing them together. Because the teacher’s back- 
ground of experience is bound to affect the way he teaches, we 
have been insisting that those who will teach educational psy- 
chology at Queens College shall have had appropriate teaching 
experience in either the elementary school or the secondary 
school. We hope our colleagues will draw upon this background 
of experience in illustrating to their students how educational 
psychology can be applied in meeting the problems which 
teachers confront in their classrooms. In this way, we hope to 
increase the transfer of training from theory to practice and to 
make educational psychology a functional part of the student’s 
preparation for teaching. A less pleasant result of this emphasis 
upon the background in elementary and secondary-school teach- 
ing is that it makes it more difficult for us to find the new col- 


leagues we need. 
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Obviously enough, the ways in which the course is organized 
influence the ways in which it is taught. After trying out 
various patterns, we have found it best for us to organize our 
educational psychology program as a two-semester course for the 
prospective teacher. By keeping the group together for a year, 
we hope to reduce the gaps and the duplication that seem almost 
inevitable when educational psychology is divided up among 
several short courses. We hope, too, that a group that stays 
together for a year will see the interrelationships among the 
various problems that are discussed. 

Fortunately, our classes are relatively small—they never go 
beyond thirty—so that our instructors get to know their students 
well in the course of a year. With classes of this size, the basic 
method of teaching is the discussion rather than the lecture. 
Every student has the opportunity of participating actively in 
the work that is done in class and outside of class. Groups of 
this size—especially when they consist of so highly selected a 
student body as we have at Queens College—are well suited to 
using such varied procedures as engaging in réle-playing, pre- 
senting panel discussions and forums, and conducting individual 
and group projects. The use of motion pictures, radio broad- 
casts, and recordings increases the variety of procedures that 
are employed in class. 


THE YEAR-LONG STUDY OF AN ORDINARY CHILD 


We look to our courses in educational psychology as being an 
important means of helping our students to understand children 
and to be able to work with them as a good teacher does. For 
this reason, the student’s study of a particular child for almost a 
whole year is an important part of the course for prospective 
elementary-school teachers. This study of a child is more than 
an assignment; it is practically a course in itself. 

After the student has had about a month in which to become 
familiar with the basic concepts, approaches, and procedures of 
educational psychology, he is asked to select a youngster with 
whom he will work for the remainder of the academic year. 
Since we are preparing elementary-school teachers rather than 
clinical psychologists, the child to be studied is an ordinary 
youngster and not the interesting deviates with whom the 
clinical psychologist spends so much of his time. Our students 
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are not yet ready to deal with children who present major 
problems because of serious physical defects, abnormal mental 
development, or severe emotional maladjustment. To encour- 
age the student’s objective reporting and analysis, we do not 
permit him to study a sibling, a member of his household, or a 
close relative. If the student is to have ready access to the child, 
it is important that he select a child where the student knows the 
family and can expect an easy working relationship with the 
family. 

As a first step, each student prepares a background report 
which summarizes the kind of information that an interested and 
competent teacher could assemble without administering any 
special tests to the child and without cross-examining the parents. 
In addition to summarizing the child’s present development, the 
report deals with the parents, the siblings, other persons in the 
household, and the home. The questions which the students 
must answer are factual and help introduce him to the distinction 
between reporting and describing, on the one hand, and inter- 
pretation and valuation, on the other hand. 

Then come six reports which are submitted about two weeks 
apart. Each of these reports is based upon the student’s 
experience with the child. In general, the major topics treated 
in each report reflect the problems that are being discussed in 
class, but the emphasis is placed upon the type of experience 
the student is having with the child rather than upon the neces- 
sity for getting answers to a specific list of questions. Thus, 
the students are encouraged to see their children in a variety of 
situations—alone with the student observer, at dinner with his 
family, on the playground with his friends, at bedtime, on a 
trip or excursion, at a movie or a television performance, etc. 
The student’s relationship with the child progresses from being 
first that of an outside observer, then of a participating observer, 
and later as a teacher guide. 


GUIDING THE INDIVIDUAL STUDENT IN HIS CHILD STUDY 


The student’s reports are written in a booklet, using only one 
side of the page, so that the instructor’s comments can be written 
on the opposite page alongside the appropriate part of the 
student’s report. The instructor’s comments sometimes include 
questions to guide the student’s further observations, suggestions 
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for activities the student should try to arrange, or possibly 
differing interpretations from those made by the student. Since 
the observations and reports are spaced, students are expected 
to use the comments on their reports in planning their next 
observation and report. 

At the end of the first semester, the student prepares a sum- 
mary of the child’s development, dealing with such items as 
his physical health and motor development, his emotional adjust- 
ment and development, his social development, his mental 
development, and the interrelationships among these phases 
of the child’s development. The student is encouraged to 
predict the nature of the problems which the child may encounter 
in the near future. The student is introduced to the teacher- 
parent relationship by being asked to list the suggestions that 
should be made to the parents and the approaches to the parent 
that seem most promising. Actually, the student makes no sug- 
gestions to the parents and his comments are used only as a 
basis for discussion in class and with his instructor. 

Since the student stays with the child for both semesters, the 
reports for the second semester are based upon the student’s 
better understanding of the child as developed during the first 
semester. The emphasis during the second semester is upon 
mental development and the psychology of learning. The 
experiences are planned in order to familiarize the student with 
the many ways in which children learn, with the specific exper- 
iences selected in terms of the child’s age and maturity. Younger 
children are read to. Student and child work together in such an 
activity as baking a cake or making puppets. Children are 
observed in their school and at a motion picture or a television 
performance. Student and child visit such places as a museum 
or @ z0o in order to see how the child reacts to being away from 
home, to note the kinds of questions he asks, and to observe how 
he learns from a new experience. Standardized achievement 
tests are administered so that the student may learn how to 
interpret the results and to use them as an aid to planning an 
appropriate program. 


USING THE CONCLUDING CHILD-STUDY REPORT 


The concluding report summarizes the changes that have taken 
place over the year. Each student prepares the kind of state- 
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ment that should properly be a part of the school record. Thus, 
students prepare a report that might be sent to parents and they 
write condensed statements that might be included in the child’s 
school folder as a guide to the next teacher. Deliberately, little 
use is made of rating scales that are not usually employed in 
schools. The student is a prospective teacher and he demon- 
strates what a teacher should know about a child. 

Since these observations -and reports are often used as the 
basis for class discussions, the students profit not only from their 
own observations, but also from the discussions of the problems 
noted by other students. We have been impressed by the 
changes we have noted during the year in the students’ under- 
standing of children and in their ability to get along with them. 
The investigations they study in class mean more to them as 
they attempt to interpret these in terms of a specific child. 
There is a marked improvement during the year as they learn 
to distinguish between observing and interpreting. 

Some of the incidental learning is exceedingly important. 
As they work with children, our students not only see motion 
pictures and television programs and books that are intended 
for children, but they see them through the child’s eyes. Work- 
ing with the child in the home, they often develop a better under- 
standing of home and school relationships and of the parents’ 
réle in education than does a student who studies educational 
psychology purely as a college subject. It may be worth report- 
ing that our graduates, when evaluating the teacher education 
program, often refer to their child study as having been one of the 
most rigorous and time-consuming phases of their program— 
but also one of the most worth-while and helpful single activities. 


THE PROGRAM FOR THE PROSPECTIVE SECONDARY-SCHOOL 
TEACHER 


For some years, we have been using a somewhat different pro- 
cedure in order to help our prospective secondary-school teachers 
to learn more about adolescents. As part of the work of this 
course, these students have been encouraged to participate 
actively in field work with community youth groups. Our 
students work with many kinds of agencies, with our selection 
influenced largely by the adequacy of the agency’s program for 
supervising inexperienced group leaders. 

When this program was studied in some detail as part of a 
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doctoral dissertation by one of the instructors in the course,* 
the tentative conclusions indicated that: ‘‘ Based on preliminary 
findings, the effects of a field work program with community 
youth groups appear as follows: (1) youth group leadership 
seems to affect favorably students’ attitudes of understanding 
and acceptance toward the behavior of young people; (2) the 
program appears helpful in modifying the attitudes of less well- 
adjusted students toward themselves; and (3) no data in this 
study support the hypothesis that field work effects changes in 
either broad social attitudes or opinions about the school’s 
procedures or roles in society.” 

We are convinced that this type of group work with youth 
agencies must be supervised and guided more effectively if it is 
to be of optimum value. For this reason, we are planning a 
reorganization of this service next September in order to see what 
will be gained if we can spend more time with the student while 
he is with the agency and if we make fuller use at college of the 
experience he is gaining while working with these groups of 
adolescents. 

With the opening of our Educational Clinic a little more than 
@ year ago, we now have additional facilities for teaching educa- 
tional psychology. Through our one-way vision mirrors, our 
students see how psychologists, psychiatrists, and social workers 
pool their efforts in order to understand and to help children who 
present learning or behavior problems. Our students can observe 
the administration of psychological tests as well as the conduct 
of a therapy session. Case conferences are arranged so that 
students may see how the results of a many-pronged investiga- 
tion of child behavior are correlated and used as the basis for 
recommendations to the school and the home. At the invitation 
of the instructors in educational psychology, members of the 
clinic staff have visited college classes or have arranged special 
demonstrations for them. 


INTERRELATING EDUCATIONAL PSYCHOLOGY AND METHODS 
COURSES 


However promising these procedures may be, they are bound 
to be less effective than we wish if we continue to regard educa- 





*Henry S. Maas. “Attitudinal Changes of Youth Group Leaders in 
Teacher Training: A Preliminary Study,” Journal of Educational Research, 
Vol. 43, May 1950, p. 666. 
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tional psychology as an isolated course to be taken, and, too 
often, to be forgotten by prospective teachers. We have 
attempted, therefore, to interrelate our work in educational 
psychology with the study of methods of teaching. Many of 
the activities in which our students engage during the laboratory 
hours of their methods courses would be just as appropriate if 
these were the laboratory hours of an educational psychology 
course. For example, we distribute diagnostic exercises that 
have been used with an elementary-school class in order that our 
students may analyze the causes of the learning difficulties and 
may plan appropriate remedial procedures. Last year we were 
about to try a more ambitious plan of integrating our educational 
psychology course for prospective secondary-school teachers 
with our course in methods of teaching in secondary schools. 
We had to abandon our plan when one of the instructors who 
was to have played a major part in this experiment joined her 
husband in moving to another part of the country. Our being 
forced to change our plans because the specific instructor we 
needed was not available indicates how vital is the réle of the 
individual instructor. If we have the kind of instructors we 
need, educational psychology can be taught effectively. Without 
them, mere devices remain mere devices. 











ISSUES IN THE MEASUREMENT OF LITERATURE 
ACQUAINTANCE AT THE SECONDARY-SCHOOL 
LEVEL 


WALTER N. DUROST 
School of Education 
Boston University 


INTRODUCTION 


It would seem reasonable to suppose that any well-rounded 
program of testing in the field of English at the secondary-school 
level would include a test covering the literary acquaintance of 
such pupils. It is admirable to measure reading ability and 
mastery of the mechanics of language. It also is an excellent 
idea (and a far more difficult task) to measure appreciation of 
literature. But a program including only these tests would fail 
to discover whether pupils are reading good literature at all and 
if so, to what extent. The present Literature Acquaintance Test 
represents one attempt to construct such a test. 


CONCERNING THE LITERATURE ACQUAINTANCE TEST! 


The Literature Acquaintance Test by Dr. Stella S. Center 
and the writer is broken into two parts. 

Part I is concerned with measuring the literature acquaintance 
of pupils by asking them to choose from among three titles 
given the one from which a carefully selected excerpt or episode 
comes. In addition the pupils were asked to state which of the 
three title choices they had read and they were told not to answer 
@ question unless they had read at least one of the three titles. 

Part II of the Literature Acquaintance Test consists of match- 
ing type exercises in which the pupil matches a quotation 
from widely read poetry with the corresponding author-title 
combination. 

This paper is concerned entirely with Part I of the test. 

The present test was intended to serve a limited and specific 
purpose; namely, to measure the extent to which high-school 
pupils are familiar with a list of one hundred twenty literature 
classics and neo-classics taken from the recommended reading 





1 The Literature Acquaintance Test is one of a new series of high school 
tests to be published by World Book Company under the title ‘‘ Evaluation 
and Adjustment Series.” 
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list of the National Council of Teachers of English. It definitely 
was not the intent of the test to measure a cross-section sample 
of everything high-school pupils are or should be reading. The 
purpose of this article is to present the data growing out of this 
attempt to make a literature acquaintance test, because it 
illustrates strikingly some of the problems involved when one 
attempts to measure educational outcomes in an area where the 
amount of agreement as to curriculum content is as limited as 
it is in this field. 


ORGANIZATION OF THE EXPERIMENTAL FORM 


After the one hundred twenty selections had been chosen 
from the National Council list, three episodes or incidents were 
prepared for each title. Every attempt was made to choose a 
passage which would get at the spirit of each selection. The 
extent to which this was accomplished is a determining factor 
in any decision concerning the validity of the test. These 
incidents were made as nearly comparable as possible in level 
of complexity and in general characteristics. The passages then 
were distributed into three parallel forms called A, B, and C. 
Since a test containing one hundred twenty items would be 
difficult to administer in a single class period, each of the forms 
was broken into two parts, making in effect six forms, A-1, A-2; 
B-1, B-2; C-1, C-2. The test was adapted for use with an IBM 
answer sheet and an experimental edition of this answer sheet 
was prepared by overprinting. 


PLAN FOR PRELIMINARY EXPERIMENTATION 


The major purpose of the preliminary tryout was to obtain 
item analysis data in order to determine the difficulty of the 
test and the discriminative value of the items included. It was 
desired to test a population which would be widely spread, geo- 
graphically. The communities finally included in the tryouts 
were Augusta, South Portland, and Waterville, Maine; Bayonne, 
New Jersey; Williamsport, Pennsylvania; and Muscateen, Iowa. 
Between five hundred and seven hundred pupils were tested in 
each of the four grades, IX through XII, inclusive. In order to 
be sure that the population was representative with respect to 
intelligence, the Terman-McNemar Test of Mental Ability was 
administered along with the experimental test. These data 
corroborate the impression that this selection of communities 
is a good representative cross section of the country with respect 
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to intelligence (average IQ from grade to grade equals 105-7). 
All children in the grades mentioned in these communities were 
included in the testing program regardless of the curriculum 
each was in. The tests were given near the end of the school 
year, 1948-49. 


PRESENTATION AND ANALYSIS OF THE DATA?” 


To provide a preliminary impression as to the nature of the 
data obtained through the item analysis tryout, Table 1 has been 
prepared. This table lists one hundred twenty titles covered by 
the tests together with the per cent of pupils correctly matching 
each episode or incident with the corresponding title in Forms 
A-1 and A-2. Only a casual inspection of this table is needed to 
reveal that very few of the one hundred twenty titles have been 
read and/or remembered by students in grade XII of the sample 
of pupils tested. It must be borne in mind that the sample of 
pupils include those taking all curricula and not just the college- 
preparatory course. The picture might be somewhat different 
if the college-preparatory group alone had been tested. It was 
the feeling of the authors, at the time the test was built, that a 
familiarity with the literary heritage of our country was impor- 
tant for all pupils regardless of curricula. 

In Table 2 will be found the distributions of scores of Form 
A-1 for each of the four grades in the tryout population. A 
glance at this table shows that the distributions are very badly 
skewed in the positive direction and this impression is corrob- 
orated by an inspection of the means, medians and standard 
deviations given at the bottom of the table. Similar data for 
all of the remaining forms show that the picture is substantially 
the same regardless of form. It is evident that, for more than a 
majority of high school students in this sample, most of the titles 
tested might just as well be in Greek, they would not be any more 
unfamiliar. On the other hand, one does find a scattering of 
pupils for whom this test indicates a generous measure of litera- 
ture acquaintance. 

One of the first criticisms made when people examine the 
test booklet without knowledge of the attendant data is that the 
test is subject to an undue amount of guessing. An examination 





* By far the largest part of the statistical work connected with this 
research was done in the Division of Test Research and Service of World 
Book Company under the direction of Mr. Roger T. Lennon, Director. 
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TABLE 1.—120 TirLes IN THE CENTER-DuRost LITERATURE 
ACQUAINTANCE TEST ARRANGED IN RouGH RANK ORDER OF 
JUDGED IMPORTANCE FOR A WELL-ROUNDED PROGRAM OF 
READING AT THE SECONDARY-SCHOOL LEVEL TOGETHER 
WITH THE PER CENT CORRECTLY IDENTIFYING THE 
SELECTION WITH THE TITLE IN Forms A-1 ANnpD A-2. 
Population—406 Pupils in Grade XII 


Title % 

Treasure Island (Steven- 
son) 52 
Rip van Winkle (Irving) 38 
Pickwick Papers (Dickens) 18 
The Odyssey (Homer) * 10 


Ivanhoe (Scott) 51 

The Taming of the Shrew 
(Shakespeare) 16 

Huckleberry Finn (Clem- 
ens) * 12 


Little Women (Alcott) * 54 
Ethan Frome (Wharton) 18 
Moby Dick (Melville) 42 
The Adventures of Tom 


Sawyer (Clemens) * 50 
The Great Stone Face 
(Hawthorne) * 19 
The Vicar of Wakefield 
(Goldsmith) * 10 
Jane Eyre (Bronte) 40 
David Copperfield (Dick- 
ens) 22 
The Merchant of Venice 
(Shakespeare) 19 
Gone With the Wind (Mit- 
chell) , 44 
Vanity Fair (Thackeray) 8 
Lord Jim (Conrad) 7 
The Forsyte Saga (Gals- 
worthy) 4 
Cranford (Gashell) 2 


The Little Minister (Barrie) 18 


Title % 

Pride and Prejudice (Aus- 
ten) 16 
Penrod (Tarkington) * 37 
King Lear (Shakespeare) 12 
The Tempest (Shakespeare) 13 

The Man Who Married a 
Dumb Wife (France)* 18 


Main Street (Lewis) 13 
Green Mansions (Hudson) 12 
Cimarron (Ferber) 5 


Scaramouche (Sabatini) * 8 
North to the Orient (Lind- 


bergh) 17 
Show Boat (Ferber) 16 
Life with Father (Lindsay 

& Crouse) 29 
Babbitt (Lewis) 9 
Justice (Galsworthy) 4 


The Coward (Maupassant)* 11 
Monsieur Beaucaire (Tark- 
ington) 27 
The Red Badge of Courage 
(Crane) 17 
Death Comes for the Arch- 
bishop (Cather) 15 
Kidnapped (Stevenson) 30 
She Stoops to Conquer 
(Goldsmith) 8 
Tess of the D’Urbervilles 
(Hardy) 10 
The Call of the Wild (Lon- 
don) 50 
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TABLE 1.—(Continued) 


Title % 
An Old-Fashioned Girl 
(Alcott) * 26 
A Descent into the Mael- 
strom (Poe) * 14 
O Pioneers (Cather) * 3 
Let the Hurricane Roar 
(Lane) * 7 
Quentin Durward (Scott) 14 
A Lantern in Her Hand 
(Aldrich) 5 
Strife (Galsworthy) 8 
Dead End (Kingsley) 8 
The White Company 
(Doyle) 9 
Master Skylark (Bennett) 4 
My Antonia (Cather) 6 
The Song of the Lark 
(Cather) 4 
Alone (Byrd) 19 
Porgy (Heyward) 8 
Mary of Scotland (Ander- 
son) 18 
Wuthering Heights 
(Bronté) 43 
The Black Arrow (Steven- 
son) 16 
The Return of the Native 
(Hardy) 13 
Daniel Boone, Wilderness 
Scout (White) 9 
Hedda Gabler (Ibsen) 5 
Beyond the Horizon 
(O’ Neill) 8 
Elizabeth the Queen 
(Anderson) 9 
The Silver Box (Gals- 
worthy) 5 
Self-Reliance (Emerson) 10 


Title 

The Admirable Crichton 
(Barrie) 

The Reds of the 
(Gras) 

Typee (Melville) 

Drums (Boyd) 

Mary Peters (Chase) 

Quality Street (Barrie) 

The Bar Sinister (Davis) 

Bridge of San Luis Rey 
(Wilder) 

The Barretts of Wimpole 
Street (Besier) 

The Autobiography of Lin- 
coln (Steffens) 

Rudder Grange (Stockton) 

Invincible Louisa (Meigg) 

The Emigrants (Bojer) 

Michael Strogoff (Verne) 

The Country of the Pointed 
Firs (Jewett) 

Abraham Lincoln (Drink- 
water) 

My Name is Aram (Saro- 
yan) 

Gold (White) 

The Skin of Our Teeth 
(Wilder) 

The Forty Days of Musa 
Dagh (Werfel) 

The Age of Innocence 
(Wharton) 

Famine (O’Flaherty) 

Berkeley Square (Balders- 
ton) 

The Griffin and the Minor 
Canon (Stockton) 

Craig’s Wife (Kelly) 


Midi 
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7% 


22 
11 
16 
10 
15 
1] 
27 
11 
11 


17 
16 


19 


10 
14 


10 
11 


13 
14 


10 
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TABLE 1.—(Continued) 


Title % Title % 
Parnassus on Wheels (Mor- The Way of All Flesh 
ley) 7 (Butler) 4 
Java Head (Hergesheimer) 7 Benjamin Franklin (van 
Maria Chapdelaine Doren) 4 
. ean (Priestly) " Man the Unknown (Carrel) 7 
nglish Journey (Pri 
The King’s Henchman The iexile (Buck) S 
(Millay) g Harriet (Ryerson and Clem- 
Winterset (Anderson) 8 ents) 7 
Singing in the Wilderness The Romantic Rebels (Win- 
(Peattie) 7 war) 3 
Suwannee River (Matschat) 6 The Last Days of Pompeii 
The Casting Away of Mrs. (Bulwer-Lytton) 16 
Lecks and Mrs. Aleshine The Able McLaughlins 
(Stockton) 8 (Wilson) 6 
The Scottish Chiefs (Porter) 7 Caponsacchi (Goodrich and 
—— for the Stars Palmer) 5 
aln 
The Scarecrow (Mackaye) 7 — Towers (Zrol- 
He Wouldn’t Be King ope) . 
(Baker) 3 The Dover Road (Milne) l 
The Magnificent Amber- The Great Divide (Moody) 6 
sons (Tarkington) 8 Victoria Regina (Housman) 9 


* From the Junior High School list; remainder are from the Senior High 
School list. 


of Table 2 indicates that this is not the case in practice, since 
the average score is far below the chance level. Since there are 
essentially three-choice multiple choice questions, one would 
expect on a pure chance basis that the average score would be 
about 20 points. The fact that the pupils did not guess was, 
no doubt, conditioned somewhat by the form of the test in that 
they were instructed first to indicate which of the three selections 
they had read and not to answer the questions if they had not 
read at least one selection. ‘Table 3 shows, for Form A-1l, the 
distribution of the number of books listed which were reported 
to have been read. The total number of titles listed in Form 
A-1 is three times the number of items or one hundred eighty. 
There are scattering cases of pupils who claim to have read more 
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TABLE 2.—NuMBER OF PupiILs WHo OBTAINED A GIVEN SCORE 





oN Form A-l oF THE CENTER-DuROST LITERATURE 
ACQUAINTANCE TEsT IN Grapes IX To XII, INCLUSIVE 





Number of Pupils in Grades 














Score 
9 10 12 
40+ 
38-39 
36-37 
34-35 1 
32-33 2 
30-31 l 5 2 
28-29 2 6 3 
26-27 5 4 10 
24-25 8 8 15 
22-23 12 20 11 
20-21 10 20 10 
18-19 16 11 11 
16-17 16 17 8 
14-15 18 12 20 
12-13 10 31 27 
10-11 30 38 18 
8-9 49 60 48 
6-7 72 75 64 
4-5 146 127 78 
2-3 171 126 79 
0-1 74 52 30 
x® 14 9 2 
Total Number 654 622 438 
Median 4.4 5.5 6.4 
Mean 6.3 7.8 8.8 
Standard Deviation 6.0 6.9 7.3 














*X = individuals who indicated by recording time limits that they had 
read test items but did not answer questions. 
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than a hundred titles, but again the distributions are very badly 
skewed as can be seen by glancing at the data at the bottom of the 
table. The data for the remaining forms show substantially 
the same picture. 

It is essential, at this point, to decide whether the results 
shown are a function of the form of the test itself or do truly 
represent the level of reading to be found among high-school 
students. This raises the fundamental question of the validity 
of the instrument. In order to answer that question we must 
again face squarely the question ‘valid for what?’ This question 
may be answered at three levels. First, is the test a valid 
measure of the extent to which pupils have read the one hundred 
twenty selections specifically covered by the test? This raises 
the question of the validity of this type of item and additional 
data will be presented on this point below. The second level 
at which one must face this problem of validity concerns the 
extent to which this list of one hundred twenty titles, selected for 
testing, is representative of the over-2000 titles included in the 
National Council recommended list. If by validity in this sense, 
one means that the one hundred twenty titles are a representative 
cross section of the total list, then the answer is that the list is 
not a representative sample, but has been specifically chosen to 
include titles felt to be of major importance. In other words, 
it is supposed to be the cream of the list, rather than a repre- 
sentative or random sample. While individual teachers might 
quibble about specific titles, it is felt that, in general, there are 
few titles listed among the one hundred twenty given where the 
literary value of the title is open to question. To look at this 
another way, one can say that it is more serious for a student to 
make a poor score on the test as it now stands, than it would be 
for him to make a poor score on a test of titles drawn by picking 
a random sample of the entire list. 

There is, of course, the even more fundamental question of 
whether the National Council reading list is a realistic reference 
list from which to draw the cultural reading of high-school 
students. The fact that it has the support and was created by 
the leaders of the National Council of Teachers of English should 
give it status in this respect. The fact that the list was approved 
by the American Library Association also enhances its impor- 
tance. The data shown seem to indicate that high-school 
students are not reading these books. Are they reading others, 
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TaBLE 3.—NvuMBER OF Pupits WHo Report Havine READ A 
GIVEN NuMBER OF LITERARY SELECTIONS ON Form A-l oF 
THE CENTER-DuRosT LITERATURE ACQUAINTANCE TEST 

In Graves IX To XII, INcLusIve 


























Number of Number of Pupils in Grades 
Selections — 
Read 9 10 11 12 
Over 100 1 1 1 1 
95-99 l 
90-94 
85-89 
80-84 1 1 
75-79 4 2 
70-74 2 3 
65-69 2 2 
60-64 5 1 2 
55-59 5 7 2 5 
50-54 2 1 2 4 
45-49 2 1 3 3 
40-44 12 8 6 ) 
35-39 10 13 11 11 
30-34 17 16 23 19 
25-29 19 36 32 39 
20-24 46 45 55 39 
15-19 75 111 100 82 
10-14 130 137 142 106 
5-9 185 143 112 62 
0-4 83 43 36 21 
No report 12 2 2 2 
Total Number 601 576 531 411 
Median 10.3 10.7 16.1 15.4 
Mean 13.2 16.3 16.0 18.9 
Standard Deviation 11.5 13.4 11.4 13.9 
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included or not included in the National Council list? That we 
cannot tell from the information at hand at the moment. That 
would require a survey of current reading on a comprehensive 
basis, something which would appear to be highly desirable. 

All of the data presented to the present time, have concerned 
only one of the six forms included in the experimental tryout; 
namely, Form A-1. It may have occurred to some that possibly 
the data for the other forms might be somewhat different, and in 
order to throw some light on this, Table 4 has been prepared for a 
limited list of fifty titles. This table shows the percentage of 
pupils correctly identifying each of the selections listed in each 
grade from IX through XII, inclusive. You will recall that 
three incidents or quotations were prepared for each of the one 
hundred twenty selections, one of which went into Form A, 
another into Form B, and the third into Form C. In this table 
you have the data to compare the per cent of pupils identifying 
the selection correctly when the incident or quotation is different 
and to do this for each of the four grades included in the testing 
programs. The fifty selections covered in this table were the 
fifty considered to be the most important of the one hundred 
twenty used on the basis of the judgment of Dr. Center, the 
senior author of this test. 

Careful study of this table will leave one with the impression 
that there is a substantial amount of agreement in the percentage 
of pupils answering the items correctly from one form to another. 
In order that one may fully appreciate what is involved here it 
should be noted that the group taking each of the three forms 
was a random third of each classroom so there is every reason to 
think that the tested samples are comparable. As to com- 
parability from grade to grade one can only say that the same 
assumption is made here that is commonly made in standardizing 
tests; namely, that today’s tenth grade is substantially the same 
as last year’s ninth, etc. In interpreting these data, it must be 
remembered also that no attempt was made to balance these 
forms for difficulty of content before actual tryout. It was felt 
that this balancing would be a direct outcome of the item analysis 
tryout. 

In order to summarize the data given in Table 4 intercorrela- 
tions of the per cent of pupils able to identify each selection have 
been worked out. The N here, of course, is the number of 
selections. The correlations for Grade IX were: Form A vs. 
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Form B, .76; Form A vs. Form C, .83; Form B vs. Form C, .88. 
For Grade 11 the comparable values were: Form A vs. Form B, 
.81; Form A vs. Form C, .84; and Form B vs. Form C, .81. 
Still more evidence can be found in the correlation of .91 between 
the per cent allocating a quotation correctly and the per cent 
saying that they have read the selection from which the quota- 
tion came. When one considers the many forces which would 
tend to attenuate these correlations, the values seem remarkably 
high and it seems reasonable to conclude that the earlier data 
presented really do represent the situation. There is an abysmal 
ignorance of these literary selections among high-school young- 
ters, if the sample tested here can be considered as representative. 


SUMMARY AND CONCLUSIONS 


On the basis of the data presented in the tables and in the text 
it seems fair to assume that the test in its present form is a valid 
measure of acquaintance with the list of titles. Thus, one is 
forced to the conclusion that in so far as the one hundred twenty 
titles included here are concerned, the high-school pupils in the 
sample tested simply are not knowledgeable or informed. The 
writers are convinced that the findings are general with reference 
to classic and neo-classic literature. It must be left for the 
curriculum-makers to decide whether or not this is an acceptable 
situation. The tempo of modern living, with especial reference 
to the impact of the radio, and now of television, may be such 
as to keep us from reading. If this is the case, it is indeed a 
matter of serious concern. 

The data shown, herein, might be summarized under the 
heading ‘‘The Testmaker’s Dilemma.” If atest may be defended 
as being face valid—or as being valid as a limited sampling of 
some larger body of material which is face valid—what shall the 
test-maker do when he finds that his instrument is so very 
inadequate from a technical point of view as a measuring device, 
due to its too great difficulty? There would appear to be very 
little use in the publication of a test of this sort where the pupil 
taking the test is doomed before hand to make a score of negligible 
proportions, unless the very fact that pupils do so poorly might 
have the effect of stimulating a revival of interest in reading 
good literature. The authors find themselves uncomfortably 
impaled on the horns of this dilemma. 














THE TESTS OF PRIMARY MENTAL ABILITIES 
APPLIED TO SUPERIOR CHILDREN* 


JOHN P. McKEE 
University of California 


This investigation attempts a preliminary evaluation of the 
Thurstone Tests of Primary Mental Abilities for Ages 5 and 6 
(PMA). Some aspects of this evaluation demand an external 
criterion, for which the Stanford-Binet revision, 1937, Form L, 
(SB) has been selected. 

Specific problems are: 

1) to determine the effective range of the PMA; 

2) to compare mean IQ’s obtained from the SB, PMA, and 
the PMA subtests; 

3) to determine the variability of such IQ’s; 

4) to determine the intra-individual variability in such IQ’s. 

Except for three pages in the Examiner Manual‘ there is no 
published information specifically relevant to this test.— It is 
an outgrowth and extension of previous investigations of the 
nature of intelligence in college students* and in children from 
11 to 17.4. In both these investigations factor analysis of test 
batteries revealed eight important factorsf or ‘primary mental 
abilities.’ Thurstone describes a primary mental ability as 
something which “in a wide variety of psychological examina- 


tions . . . behaves as a functional unity that is strongly present 
in some tests and almost completely absent in many others.’’* 
(p. 9) 


The PMA was also preceded by a factor analysis and the five 
primary abilities “‘appearing both prominently and capable of 
measurement in a group testing situations’’® (p. iii) were chosen 
for it. 

Since the SB is being used as a means of evaluating the PMA, a 
difference between them must be recognized: according to 





* An abridgement of a Master’s thesis, August, 1947, on deposit in the 
library of the State University of Iowa. The writer expresses his appre- 
ciation to Professors Beth L. Wellman and Howard V. Meredith for their 
interest, help, and supervision. 

t The revised manual (6) reports factor intercorrelations of +.46 to +.67. 

tSpace, perceptual speed, number, verbal relations, word-fluency, 
memory, arithmetical reasoning, and deduction. 
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McNemar’s analysis,? the SB contains only one important factor 
and perhaps a secondary factor for some age levels. It would 
not be unexpected if some PMA factors showed little relationship 


to the SB. 


DESCRIPTION OF THE PMA 


The PMA consists of the five following primary abilities: 
Verbal-meaning (V), Perceptual speed (P), Quantitative (Q), 
Motor (Mo), and Space (8). 

Except for Mo, which does not enter into the computation of 
total IQ and is not included in this investigation, each ability is 
tested by a variety of items. V includes vocabulary, sentence 
comprehension, sentence completion, paragraph comprehension, 
and auditory discrimination. P includes two timed tests: 
locating identical pictures, and locating identical, semi-abstract 
forms. Q includes counting, ‘comprehension of quantitative 
concepts,’ and ‘story problems.’ S involves locating the missing 
piece of a square, and completion, by drawing, of incomplete 
designs. 

Except for incomplete designs and Q, each item is a four- 
possibility multiple-choice problem. The child simply marks 
the correct answer. In the case of designs considerably more 
skill in manipulating a pencil is necessary. Q demands that 
several (the correct number) pictures be marked. 

The PMA is designed for groups of five to ten subjects. The 
examiner reads the problem and the children mark the correct 
answer in their booklets. Auditory discrimination items may 
not be repeated, but, at the examiner’s discretion, other problems 
and questions may. The forty-nine verbal items and thirty 
perceptual speed items are given in one session. Q and S are 
given in a second session, presumably the next day. They 
include twenty-seven and twenty-four items, respectively. 
Practice items precede each subtest or factor. 

Total MA is based on total right. Each factor may also be 
scored and converted to MA separately, thus giving a profile of 
abilities. 

Eighty subjects were used: those sixty children (thirty-seven 
boys and twenty-three girls) between the ages of 5-0 and 6-11 
who were enrolled in the preschool and elementary school of the 
University of Iowa in the spring of 1947, and a group of twenty 
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children who are beyond the age range for which the PMA is 
designed. The latter group was included since the effective 
range of the PMA was of interest. It includes selected pre- 
cocious children younger than five and all first-graders older than 
6-11. The subjects’ families are primarily professional. 


PROCEDURE 


Three experienced testers, working independently of the PMA 
tester, administered the SB as part of the annual spring mental 
testing program of the Iowa Child Welfare Research Station. 
The maximum interval between the SB and the PMA was two 
months and six days. In only eleven cases did the CA used in 
computing SB and PMA IQ differ by more than one month. 

All PMA’s were given by one tester. The main group of 
subjects was tested in groups of four and an attempt was made 
to keep each group intact from one session to the next. Where 
absence or school activities made this impossible another child 
was substituted. One child was tested alone in both sessions, 
and one group contained only three children for the second 
session. In every case the interval between the two PMA 
sessions was between one day and one week. 

Children older than 6-11 (except one very negative boy tested 
alone) were also tested in groups of four, while those younger 
than 5-0 were tested singly. Children tested alone took from 
two to four sessions, depending on the state of rapport and 
degree of fatigue. 

In addition to the adaptations made for younger children 
several modifications of the recommended procedure’ were made 
for all subjects. 

1) Previous experience proved it necessary to caution the 
children against answering aloud and against trying to see other 
children’s booklets. 

2) Children who finished P before the time limit were urged 
to review their answers. 

3) In giving S no blackboard was used to demonstrate the 
practice items. 

4) The children were provided with erasers and told to use 
them whenever they wished. If a child asked to have an answer 
erased by the examiner, the request was granted. 











48 The Journal of Educational Psychology 


5) The children frequently requested that paragraph com- 
prehension items be repeated and as many as four repetitions per 
item were allowed. This last modification was introduced 
because of confusion which the children expressed when the 
direction ‘‘mark it’’> was given at the end of the item. When 
the item ended with a noun there was often a question as to 
whether the noun (for instance “‘his pipe’’) or “‘the picture that 
goes with this story’’ was to be marked. 


RESULTS 


Range of the PMA.—Table I presents the frequencies with 
which children of the four chronological age groups hit ceilings 
(MA of 9-0) on the total PMA and on the factors. 


TABLE I.—DISTRIBUTION OF CEILING SCORES 


CA N PMA V P Q S 

7 7 4 3 5 5 2 

6 31 1 4 g 8 3 

5 29 1 1 2 3 2 
Under 5 13 — — — — — 


The seven-year-olds hit ceilings nineteen times out of a possible 
thirty-five. Every child hit at least one ceiling and one child 
hit all five. The six-year-olds hit ceilings twenty-five times out 
of a possible one hundred fifty-five, and the five-year-olds, nine 
times out of a possible one hundred forty-five. In the last two 
groups no child hit all five ceilings: one five-year-old, however, 
hit four. It does not appear likely then that the PMA is suitable 
for superior children older than CA 6-11, nor does it appear 
ideal for superior children from 5-0 to 6-11. For an average 
group of seven-year-olds the PMA will probably at least differ- 
entiate superior children from others. For six-year-olds the 
PMA ceiling is too low to differentiate among very bright 
children, but it does give differentiable scores for the others. 
Among five-year-olds only extremely superior children obtain 
ceiling scores. As CA increases ceiling effects naturally become 
more important. The PMA will thus not be suitable for longi- 
tudinal studies, even with an average group of children. 

In attempting to extend the PMA to younger children several 


difficulties were encountered: 
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1) The amount of time required is excessive. The one hour 
estimate’ of total testing time was found inadequate even for 
children age five and six. An hour and forty minutes appears 
much closer to the average. V and Q were especially demanding 
in this respect, frequently taking thirty-five to forty minutes 
each. While the length of the test did not interfere with testing 
in the six-year-olds, it became a distinct handicap for the younger 
children. They tired and lost interest, and it was difficult to 
establish rapport for the following sessions. 

2) As age decreased it became more difficult for the children to 
understand the speed aspect of P. In some cases the experi- 
menter was forced to point to the next line after the previous 
item had been completed in order to have the child continue. 
It is impossible to evaluate the influence of this variable in the 
testing situation. 

3) For some children the test for factor Q became almost 
completely a failure situation.* The effect of the failure on the 
Q score itself is difficult to evaluate. In addition it made rapport 
for S difficult to establish even when S was put off until another 
session. 

4) Scoring the design completion items of the test for S is very 
difficult. The very young children, and some five-year-olds, 
lacked skill in manipulating pencils. Evaluation of the degree 
to which poor motor skill enters into the child’s performance is 
subjective, but it must be made if the score is to represent S. 

These four difficulties suggest that the PMA is not suitable for 
children younger than CA 5-0. This view is strengthened by the 
fact that two of the thirteen children in this superior group (mean 
SB IQ was 135) simply refused to come for additional test 
sessions. It is possible that the PMA is feasible for very superior 
young children: nine of the children younger than 5-0 were able 
to complete the test without having to be urged so much as to 
make their scores completely invalid. Their mean SB IQ was 
145 and ranged from 131 to 178. 

Difference in Mean IQ.—The findings which follow are based 
solely on children whose CA is within the age range for which 
the PMA was standardized. Three approaches were thought 





*This complication also appeared in one five-year-old who had not 
learned to count and in another whose grasp of Q was poor. The SB IQ’s 
for these two children were 77 and 123. 
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helpful: comparison of means, comparison of variabilities, and 
examination of the difference between scores on the various 
tests for individual children. 

Are there age differences in IQ? Table II gives the mean for 
each test and the levels of significance* for age differences. V 
is the only factor showing a significant age difference. In 
general the younger children achieve higher I1Q’s, but the low 
ceilings of the PMA presumably depress the scores of the six- 
year-olds. Whether the trend would be present if the PMA 
ceilings were higher cannot be answered with the present data. 


TaBLE IJ.—Mean IQ’s By AGE For Eacu TEST 
Mean IQ for Mean IQ for Significance 
Six-year-olds Five-year-olds of Difference 


N = 3l N = 29 
SB 124 129 — 
PMA 120 124 — 
V 121 131 1% 
Pp 119 119 — 
Q 123 123 _ 
S 113 122 — 


So far as mean differences between the SB and the PMA are 
concerned, only SB —S for six-year-olds is significant (the 
difference of over 10 IQ points is significant at the one per cent 
level). There is a tendency for the SB to give a higher mean, 
but in view of the fact that the subjects have had a good deal of 
experience with the SB it seems wise to interpret the trend 
cautiously. The writer is somewhat surprised that the ‘single- 
factor’ SB is not more different than these results imply. 

Are there significant differences between factor means? 
Table III suggests that six-year-olds score lower on § than on 
the other factors, the difference being significant in comparison 
with V and Q, while five-year-olds score higher on V. Con- 
sidering the group as a whole it appears that V and Q are easier 
than S and P, though the rank orders are not the same in the 
two age groups. Whether this pattern is true of children in 
general, superior children, or just children of professionals can 
be determined only with additional samples. 





* All tables include levels of significance of five per cent or greater. Levels 
of significance less than five per cent are not reported. 
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TasBLe IIJ.—Mean IQ Dirrerences By AGE: FAcToR 


CoMPARISONS 





Six-year-olds 


Five-year-olds 











N = 31 N = 29 

M Level of M Level of 

Diff Signif Diff Signif 
V-P ‘7 -—— 11.9 1% 
V-Q —1.9 — 8.0 5% 
V-S 7.4 2% 9.4 5% 
P-Q —3.6 — —3.9 — 
P-S 5.7 -— —2.5 -- 
Q-S 9.6 1% 1.4 — 














TaBLE IV.—RANGE AND STANDARD DEVIATION oF IQ By AGE 
FOR THE Six TEsTsS 


PMA 


Ra ©6§ ws «< 


SD 
Range 
SD 
Range 
SD 
Range 
SD 
Range 
SD 
Range 
SD 
Range 


Six-year- 


olds 
14.4 
96-147 
12.3 
90-139 
11.6 
95-138 
17.9 
75-146 
16.3 
86-142 
15.6 


91-142 


Five-year- 


olds 
17.9 
77-167 
20.6 
71-163 
16.1 
93-159 
22.9 
77-174 
25.8 
51-171 
27.3 
66-165 


Signif of F 


5% 


1% 
1% 


Variability of IQ.—Two aspects of variability are considered: 
Are there age differences? Are there test or factor differences 
at a given age? 

Table IV shows five-year-olds to be more variable than six- 
year-olds; the age differences are significant for V, Q and S. 
If the F for V is accepted as indicating a true difference in vari- 
ability, then the significant ¢ also found for V (Table II) may 
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reflect largely the difference between the variances and not 
the mean difference. Or there may be a true difference in both. 
Doubtless the ceiling effect in the older subjects affects both 
means and variances. But this factor does not account for the 
lower variability at six years with the SB. Possibly it is due 
simply to sampling errors, but this explanation is not very 
satisfactory for the original SB standardization group’ shows 
the same trend. 

Table V deals with variance ratios based on factor comparisons. 
Evidently V is significantly less variable than the other factors. 


TABLE V.—CoMPARISONS OF VARIANCES OF IQ DIstrrRiIBUTIONS 











Level of Significance of F 
Six-year-olds Five-year-olds 

V:P <1% <5% 
V:Q <5% <1% 
V:S <1% <1% 
P:Q —- _-- 
P:S — — 
Q:S — _— 
SB:V --- — 
P:SB --- — 
Q:SB — <5% 
S:SB — <5% 











It is probably due to the professional status of the families of 
these particular subjects combined with a (for them) low ceiling. 

Intra-individual variability—Does a child who scores high on 
one test score high on all other tests? Or does he score high on 
just one test? What is the range of an individual’s IQ on the 
several tests? 

Examination of the distributions of differences between pairs 
of tests (Table VI) reveals that five-year-olds have the larger 
ranges (eight of the eleven comparisons), and larger standard 
deviations (seven of the eleven comparisons). The indication 
that five-year-olds have a larger intra-individual variability is 
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further supported by Table VII which gives distribution of 
individual ranges on all six tests and on the PMA factors alone. 
Thus we can say that the five-year-olds are not only more 
variable as a group (Table IV), but also that the distribution of 
abilities within individual five-year-olds is more heterogeneous 
than it is within individual six-year-olds. It is of course possible 
that the age difference in ceiling effects is the sole explanation for 
both phenomena, but maturational and environmental theorists 
will doubtless be interested in pursuing this lead with a more 
average sample before accepting so statistical a conclusion. * 


TaBLE VII.—RANGE IN IQ By AGE 














Six-year-olds Five-year-olds 
N = 31 N = 29 
Range 
miQ | sal Six PMA All Six PMA 
Tests Factors Tests Factors 
0- 4 —- 1 ( 3%) — — 
5-14 2( 7%) 3 (10%) 2( 7%) 4 (14%) 
15-24 8 (26%) | 10 (82%) 6 (21%) 7 (24%) 
25-34 12 (38%) 8 (26%) 6 (21%) 7 (24%) 
35-44 6 (19%) 8 (26%) | 11 (388%) 7 (24%) 
45-54 3 (10%) 1 ( 3%) 2( 7%) 2 ( 7%) 
55- _ oe 2( 7%) | 2( 7%) 
Range 5-52 4-47 7-65 7-65 














Table VIII is the same as Table VII except that each indi- 
vidual’s most extreme score has been eliminated. The median 
range in IQ is decreased by about fifty per cent, being about 15 
as compared with 30 or 35 in columns 2 and 4 of Table VII. If 
this indication of a single large discrepancy is substantiated by 
other work it will have considerable significance for the theory of 
intelligence. Environmentalists will look for experiences that 
lead to such differences; nativists will be convinced of the 
‘primacy’ of the various mental abilities. 





* Professor H. E. Jones has suggested that a probable lower reliability 
in five-year-olds might be a contributing factor. 
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SUMMARY AND CONCLUSIONS 


Eighty superior children in the University of Iowa elementary 
school and preschool were tested on the Thurstone Tests of 
Primary Mental Abilities for Ages § and 6 (PMA) and the Stan- 
ford-Binet Revision, 1937, Form L (SB). 

The PMA proved to be interesting and attractive to the 
children, who for the most part seemed to enjoy the testing. 
Certain difficulties in administration necessitated modifications 
in the recommended procedure, and occasionally scoring problems 
were encountered. For the youngest children and for the less 
bright children fatigue and motivational problems arose. 


TaBLeE VIII.—RancGe 1n IQ witH Most ExTREME ScoRE FOR 
Eacu INDIVIDUAL ELIMINATED, BY AGE 


Range in Six-year-olds Five-year-olds 
IQ N = 31 N = 29 
0-4 2 ( 7%) 1 ( 3%) 
5-14 15 (48%) 13 (45%) 

15-24 13 (42%) 8 (28%) 
25-34 1 ( 3%) 5 (18%) 
35-44 — 1 ( 3%) 
45-54 —_— 1 ( 3%) 


As judged by the number of ceiling scores obtained the present 
form of the PMA is probably unsuited for application with 
seven-year-olds. While adequate to differentiate among most 
superior six-year-olds, it appears inadequate to differentiate 
among those who are very superior. For five-year-olds it is 
only among very extreme cases of superiority that the PMA fails 
to distinguish. Children younger than five found the test too 
long and too difficult. 

Comparisons with the SB suggest that the PMA gives a slightly 
lower IQ on each of the subtests for both five- and six-year-olds, 
but one comparison (SB-V for five-year-olds) runs counter to 
this trend. 

Comparisons suggest that some of the factor means differ 
from each other, but only two of the twelve comparisons were 
significant at the one per cent level. Age comparisons suggest 
higher IQ scores for younger children. Within a given age 
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group eight variance-ratios were significant, four at the one per 
cent level and four at the five per cent level. Factor V is appar- 
ently the least variable. In all age comparisons there was 
greater variability in the younger children, but only for factors 
Q and S were the F’s significant at the one per cent level. V was 
significant at the five per cent level. 

Examination of the range of IQ’s attained by individuals 
indicates that over fifty per cent of the children obtained factor 
scores which vary more than 25 or 30 IQ points. 

These findings must be regarded as tentative. While accept- 
ably high levels of statistical significance have been found in 
some cases, they have been the exceptions rather than the rule. 
Other findings have been qualitative. The sample consists of 
superior children with rather unique home and school char- 
acteristics. Should a study now in progress with a more typical 
group of subjects yield similar results, considerably more con- 
fidence will be justified. 
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BOOK REVIEWS 


JOHN DoLLARD AND NEAL E. Mituer. Personality and Psycho- 
therapy. An Analysis in Terms of Learning, Thinking and 
Culture. New York: McGraw-Hill Book Company, Inc., 
1950, pp. 488. 


This book by two well-known members of the Institute of 
Human Relations of Yale University represents a real synthesis 
of their thinking in an attempt to describe analytical psycho- 
therapy in terms of the particular learning theory which has 
been associated with the work of Clark Hull at Yale and in 
particular the interpretation of Hull’s theories by Miller. The 
book is divided into eight parts but more simply one might say 
that the first portion of the book is devoted to an exposition of 
learning theory which is acceptable to the two authors, and the 
second part of the book is an analysis of analytical psychotherapy 
in terms of this learning theory. Although both authors have 
had responsibility for both parts of the book, it is clear that the 
first part is primarily the responsibility of Miller, whereas the 
second part dealing with psychotherapy has been principally 
the responsibility of Dollard. However, Miller has thoroughly 
assimilated the psychotherapeutic principles advocated by his 
partner, and Dollard, on the other hand, has thoroughly assimi- 
lated Miller’s learning theory and is able to discuss his ideas 
about psychotherapy in terms of this learning theory. Probably 
the two authors would claim that the book is a joint product 
throughout. 

The section on learning is in part a repetition and in part an 
elaboration of the earlier book by these two authors.' A com- 
parison of the two texts shows that at the beginning whole 
portions of the older text have been repeated but the present book 
elaborates the réle of language in learning beyond what was 
included in the earlier book. 

The book is clearly written, has a sense of reality, is provided 
with copious illustrations and gives the reader a feeling that the 
authors know intimately how people feel and react. 





1N. E. Miller and John Dollard. Social Learning and Imitation. New 
Haven: Yale University Press, 1944. 
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As a textbook on psychotherapy, this book may prove some- 
thing of a difficult hurdle. The technical language with which 
the discussion of therapeutic principles is clothed may be a 
barrier to those who have not made themselves master of current 
learning theory. For instance, although the word ‘transference’ 
is used frequently ‘generalization,’ a current term in learning 
theory, is used synonymously. Fear is used in place of anxiety 
in some of the earlier discussions probably in the interest of 
simplicity. Stupidity is sometimes used almost synonymously 
with repression and labelling is a term which is used to indicate 
a great deal of what is technically known as interpretation. 

To illustrate the technical nature of the language, consider the 
following excerpt from page 322: “One of the functions of verbal 
and other cue-producing responses is to make innately similar 
situations more distinctive and thus to cut down on the amount 
of primary stimulus generalization.” This statement intends 
to convey the idea that to the extent that a person is aware of 
the differences between a present and past situation he is less 
likely to respond blindly to the present situation as he did to the 
past situation which has some points of similarity. Or with 
reference to psychotherapy, if a person can be helped to verbalize 
and hence become aware of the conditions in which certain 
emotional reactions were learned as a child their inappropriate- 
ness in the present situation would become distinct and vivid. 

Among some of the high spots in the book, first should be 
mentioned the simple clear analysis of the nature of neurosis in 
terms of conflict, repression and symptoms. This reviewer 
noted that anxiety seems to be understressed as a motivating 
factor in this analysis of neurosis although the authors recognize 
the place that anxiety plays in their later discussion. 

One major contribution in this book is the emphasis on lan- 
guage as an element in human behavior with assertions and 
demonstrations to give credence to their belief that language as 
an element in human behavior follows the same forms of learning 
as other forms of behavior. They proceed to demonstrate that 
differential responses \become attached to internal processes, of 
which language is one example, in exactly the same way as these 
differential responses are attached to external cues. Words 
have two functions in this process. First, they are responses 
that can be attached to or associated with cues that mediate 
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behavior, and, second, words may produce (or be) cues that can 
elicit specific responses. Considerable emphasis is given to a 
concept of words as cue-producing responses. A cue-producing 
response is one whose main function is to serve as a cue, that is, 
as part of a stimulus leading to another response. In other 
words, words may serve as guides to behavior. This concept 
has been discussed in psychological literature under the older 
term ideo-motor action. James dallied with this idea in Volume 
II of his Psychology and Thorndike discusses it in Volume I of 
his three-volume work on Educational Psychology. Thorndike 
has said: ‘‘When an idea does produce the movement which 
it is an idea of, that movement gives evidence of having been 
bound to that idea by exercise or effect.”? Dollard and Miller 
go on to use the term ‘label’ as a specific illustration of a cue- 
producing response. Later in the book, they give as one of the 
aims of therapy the establishment of labels or cue-producing 
responses. Psychotherapists believe that as one acquires the 
proper way of thinking about himself that this will translate 
itself into reorganization of personality and character. Social 
training is necessary for the learning of these cue-producing 
responses, and psychotherapy is one highly structured form of 
such social training. 

Another point which is emphasized in the book is the fact that 
reinforcement operates in a direct way without the intervention 
of cognition and conscious awareness, and later in the book this 
principle is used to explain unconscious activities operationally. 

Among other aspects of learning theory which are emphasized 
as a basis for explaining elements of the therapeutic process is 
the anticipatory response, that is, a response which is made 
earlier in the sequence of responses to cues than was the case in 
the original learning. The anticipatory response is used as a 
partial explanation of repression. Repression is thought of as 
the act of ‘stopping thinking’ before the memory of a traumatic 
incident comes to consciousness. Stopping thinking is thought 
of as a response which anticipates the response of memory which 
is thereby prevented from taking place. 

Another principle that fear reduction serves as a reinforcement 





*E. L. Thorndike, Educational Psychology, Vol. I, p. 185. New York: 
Bureau of Publications, Teachers College, Columbia University, 1913. 
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of responses which are coincident with it is used to illustrate the 
process of therapy. The reassurance which comes from accept- 
ance and lack of criticism by the therapist helps to reduce fear, 
and this fear reduction serves as a reinforcement for the recovery 
of lost memories and for the release of impulses in general. 

The two-factor theory of learning which Mowrer feels is so 
important in explaining what takes place in therapy seems to be 
side-stepped in this book. On page 42, the authors say: “‘The 
basic logic of this book would not be affected materially by any 
of these different views.’”’ They later say that in their judgments 
‘fall habits seem to obey exactly the same laws, e.g., the gradient 
of reinforcement, generalization, extinction, spontaneous recovery 
and so forth.” Fear or anxiety is recognized as being both a 
drive and a cue. As a cue, anxiety helps to transfer responses 
to new situations and this becomes an important point in the 
theory of neuroses. 

Some of the noteworthy portions of the second half of the book 
are the attempts to describe the mechanisms of defense against 
anxiety in terms of learning theory; a splendid treatment of 
repression based on the general concept of ‘stopping thinking’ 
as a response; the belief that repression is in large part a response 
to punishment and a clear-cut distinction between repression 
and inhibition with the implications of this distinction. So often, 
in discussion of psychotherapy, it is assumed that to reduce 
anxiety and help the client to recover lost memories in itself has 
therapeutic value. These authors, however, emphasize that 
after previous experience is accessible to consciousness and the 
client is able to verbalize it, there is still necessary a process of 
relearning in which the individual discovers methods of making 
adjustments to his present problems in the light of his new found 
understanding of his own impulses and standards with reference 
to these problems. There is, in general, an emphasis on the 
importance of intellectual control over behavior. 

Part VI consists of a splendid analysis of conflict in terms of 
learning theory which in general follows along the lines of Miller’s 
chapter (XIV) in Hunt’s Volume I of Personality and the Behavior 
Disorders but carries the discussion in Hunt’s book somewhat 
further.* In particular, it is now recognized that the approach- 





*J. McV. Hunt, Editor. Personality and the Behavior Disorders, 2 vols. 
New York: The Ronald Press Company, 1944. 
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avoidance conflict is similar to the ego-id conflict in Freudian 
theory and an analysis is made of the ego-id conflict in terms of 
the factors which Miller recognizes in his experimental work. 

There is a discussion of the possibilities of psychotherapy 
where conditions are not ideal and this apparently is where the 
impact of culture enters into the discussion of psychotherapy in 
this book. 

Two final chapters, one dealing with self-study (a new term 
for self-analysis) and the other dealing with the value of sup- 
pression are superb. In older discussions of self-analysis, self- 
analysis has been contrasted with the psychotherapy carried 
out with the aid of a therapist. In this discussion, however, 
self-study is thought of as something that is learned through the 
process of psychotherapy as carried out with the aid of a therapist. 
Stating it simply, one learns how to study oneself through the 
process of psychotherapy. The last chapter emphasizes that 
there is value to suppression. So often, the work of Freud is 
interpreted as signifying that there is no place for suppression 
in human affairs. Dollard and Miller, however, point out that 
while there is a place for free association during psychotherapy, 
in normal living one must exercise brakes and controls over one’s 
mental processes in the interests of efficiency and creative- 
ness. There is a time to concentrate and to put aside one’s 
troubled thoughts and this can be done through a manipulation 
of attention. 

This reviewer finds only a few points to criticize and queries 
to raise in the book. He is troubled with the definition of drive 
as any strong stimulus (which was also given in the earlier book 
by Miller and Dollard). It is disturbing to find that this defini- 
tion is retained in the present book. Somehow, this definition 
of drive misses the point. While it is recognized that strong 
stimuli such as loud noises, blinding lights, penetrating odors 
and the like do initiate action, it is believed that the essence of a 
drive is not the strength of the stimulus but the annoyingness, 
disagreeableness, and painful qualities of the stimulus. To define 
drive in terms of the strength of stimulus seems to ignore the 
dynamic feature of drive and fails to tie in to the biological 


process. 
A second disappointment in the book is the fact that there is 


not reference to the self-concept in the analysis of neurosis. 
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Apparently these authors do not find it necessary to pay atten- 
tion to the attitude of an individual toward the self in their 
analysis of neurosis. Recent discussions, however, would 
indicate that the attitude of an individual toward himself is an 
integral part of neurotic disturbance and something that cannot 
be disregarded in the therapeutic process.‘ 

Different types of neurosis are not recognized and consequently 
the process of psychotherapy is undifferentiated. Apparently, 
one uses the same approach and procedures for every type 
neurotic disturbance that an individual comes for help about. 
In particular, no attention was paid to compulsive and obsessional 
neuroses. 

To elaborate on the last point made no attention was paid to 
those cases where the ego is closely allied with superego trends. 
Where this dynamic state of affairs prevails, merely to reassure 
the client through acceptance and permissiveness is hardly going 
to be sufficient to reduce anxiety and to break into the basic 
conflict. The individual instead of identifying himself with the 
therapist holds on tenaciously to his identification with his 
own self-concept which is in reality a tenacious holding on to 
identification with past figures. Somehow something is required 
over and above the therapeutic principles enunciated in this book 
to break through these inner barriers in the individual. 

Considerable emphasis is given in the book to a discrimination 
between present and past in line with the general Freudian 
principle that if one can discover the origin of his conflict, he 
will find that it pertains to conditions which no longer are present 
and consequently the form of adjustment that is adopted is 
inappropriate to the present. Too little emphasis in the book, 
however, has been given to discriminating different conditions 
within the present and how the adjustment of the individual 
fits one set of present circumstances but fails to be wholly realistic 
in another set. Perhaps this form of discrimination is implied in 
the discussion but certainly it does not receive major emphasis. 

One is intrigued throughout the book and particularly in the 
bibliography in the end by new research, much of it still not 
published at the time the book went to press. In particular, 
several papers are promised by Miller which provide experi- 





‘Pp. M. Symonds, The Ego and the Self. New York: Appleton-Century- 
Crofts, 1951. 
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mental verification of several of the principles which are eluci- 
dated in the book. At the time of this writing, one of these 
publications’ has come to hand with a chapter by Miller on 
“‘Learnable Drives and Rewards”’ in the section dealing with 
“Motivation.” 

This book, in this reviewer’s judgment, makes an important 
contribution to our fast-growing knowledge of personality theory 
and to the present interest in psychotherapy. As he read it, he 
felt that it was a book of the decade and he had something of the 
same thrill that he had in reading Murray’s Explorations in 
Personality® over a decade ago. There is much to chew over in 
this book and it will serve as a stimulus to students of learning 
theory and personality theory for years to come. 

PercivaL M. Symonps 

Teachers College 

Columbia University 


C. P. Strong, Editor. Annual Review of Psychology. Vol. II, 
1951. Annual Reviews, Inc., 1951, pp. 389. 


This series, commenced a year ago, may not yet be known to all 
who use psychology. It should be, and it should be on the desk 
of every teacher of psychological subjects. Competent reviewers 
choose and here summarize the important studies in each area. 
The result keeps one up-to-date, evaluates each field, points out 
major trends, and is extremely convenient as a source of recent 
references for the student who is gathering information on a 
particular topic. The list of authors for Volume II is as impres- 
sive as that for Volume I. Barker replaces Jones and Bayley for 
the chapter on development, Buxton replaces Melton on learning, 
and so on. The editors selected their writers well. The one 
complaint with the book is the idiosyncratic bibliographic form. 

In this review, Stroud’s treatment of educational psychology 
demands special attention. Like all of the writers, Stroud has 
lacked space to extend his personal criticisms and interpretations, 
but it is evident that he has carefully scrutinized the studies and 





*S. 8. Stevens, editor. Handbook of Experimental Psychology. New 


York: John Wiley and Sons, Inc., 1951. 
*H. A. Murray. Ezplorations in Personality. New York: Oxford Uni- 


versity Press, 1938. 
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that those he endorses are important to know about. Stroud’s 
comments on the field itself are noteworthy. He is clear in his 
own mind that educational psychologists are responsible less for 
investigating behavior than for interpreting learning and learners 
to the teacher. He thinks this can best be done through sound 
practical principles, not through training teachers to follow 
scientific-theoretical reasoning for themselves. To an over- 
whelming extent, the literature he finds to review, which is 
presumably the whole of contemporary educational psychology, 
consists of judgments, comments, and opinions. There are 
important reports of carefully evaluated evidence, but the others 
seem to constitute at least half of Stroud’s one hundred fifty-four 
references. To this reviewer, the astonishing thing is that 
Stroud seems to find nothing to view with alarm in this. To say 
the least, Barker reacts quite differently to the same facts in the 
child psychology literature. Stroud does present a thought- 
provoking demand for better development and use of con- 
temporary learning theory in education. 

Preference among the other seventeen chapters will no doubt 
depend upon the reader’s professional interests. There is little 
discernible variation in quality, thoughtfulness, and level of 
judgment. Special interest attaches to those chapters where the 
reviewers have made a creative contribution by synthesizing or 
extending their own interpretations well beyond the usual brief 
summary. Attention is therefore directed to Leona Tyler on 
Individual Differences and Daniel Katz on Social Psychology. 
With some reservation regarding the ideas expressed, Barker’s 
chapter and Hathaway on Clinical Psychotherapy may also be 
so listed. LEE J. CRONBACH 


University of Illinois. 
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